Pandas Profiling Report

Dataset statistics

Number of variables	19
Number of observations	319749
Missing cells	9339
Missing cells (%)	0.2%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	42.7 MiB
Average record size in memory	140.0 B

Variable types

BOOL	11
NUM	8

Warnings

`Diabetic` has 9339 (2.9%) missing values	Missing
`df_index` has unique values	Unique
`PhysicalHealth` has 226557 (70.9%) zeros	Zeros
`MentalHealth` has 205367 (64.2%) zeros	Zeros
`Race` has 5201 (1.6%) zeros	Zeros
`GenHealth` has 66832 (20.9%) zeros	Zeros

Reproduction

Analysis started	2022-05-06 14:04:39.247276
Analysis finished	2022-05-06 14:05:15.469230
Duration	36.22 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	319749
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	159897.1634
Minimum	0
Maximum	319794
Zeros	1
Zeros (%)	< 0.1%
Memory size	2.4 MiB

Quantile statistics

Minimum	0
5-th percentile	15990.4
Q1	79949
median	159896
Q3	239844
95-th percentile	303805.6
Maximum	319794
Range	319794
Interquartile range (IQR)	159895

Descriptive statistics

Standard deviation	92316.78096
Coefficient of variation (CV)	0.5773509609
Kurtosis	-1.199977999
Mean	159897.1634
Median Absolute Deviation (MAD)	79948
Skewness	1.558113976e-05
Sum	5.112695811e+10
Variance	8522388046
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
213195	1	< 0.1%
213202	1	< 0.1%
213201	1	< 0.1%
213200	1	< 0.1%
213199	1	< 0.1%
213198	1	< 0.1%
213197	1	< 0.1%
213196	1	< 0.1%
213194	1	< 0.1%
Other values (319739)	319739	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
319794	1	< 0.1%
319793	1	< 0.1%
319792	1	< 0.1%
319791	1	< 0.1%
319790	1	< 0.1%

HeartDisease
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	292383
1	27366

Common Values
Chart

Value	Count	Frequency (%)
0	292383	91.4%
1	27366	8.6%

BMI
Real number (ℝ_≥0)

Distinct	3579
Distinct (%)	1.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	28.32766192
Minimum	13.02
Maximum	94.85
Zeros	0
Zeros (%)	0.0%
Memory size	2.4 MiB

Quantile statistics

Minimum	13.02
5-th percentile	20.14
Q1	24.03
median	27.34
Q3	31.44
95-th percentile	40.18
Maximum	94.85
Range	81.83
Interquartile range (IQR)	7.41

Descriptive statistics

Standard deviation	6.353754415
Coefficient of variation (CV)	0.2242950524
Kurtosis	3.893894458
Mean	28.32766192
Median Absolute Deviation (MAD)	3.66
Skewness	1.33521651
Sum	9057741.57
Variance	40.37019517
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
26.63	3762	1.2%
27.46	2767	0.9%
27.44	2723	0.9%
24.41	2696	0.8%
27.12	2525	0.8%
25.1	2262	0.7%
28.7	1968	0.6%
29.53	1894	0.6%
32.28	1878	0.6%
29.29	1869	0.6%
Other values (3569)	295405	92.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
13.02	2	< 0.1%
13.04	2	< 0.1%
13.08	1	< 0.1%
13.12	1	< 0.1%
13.17	1	< 0.1%

Value	Count	Frequency (%)
94.85	1	< 0.1%
94.66	1	< 0.1%
93.97	1	< 0.1%
93.86	1	< 0.1%
92.53	1	< 0.1%

Smoking
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	187861
1	131888

Common Values
Chart

Value	Count	Frequency (%)
0	187861	58.8%
1	131888	41.2%

AlcoholDrinking
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	297978
1	21771

Common Values
Chart

Value	Count	Frequency (%)
0	297978	93.2%
1	21771	6.8%

Stroke
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	307684
1	12065

Common Values
Chart

Value	Count	Frequency (%)
0	307684	96.2%
1	12065	3.8%

PhysicalHealth
Real number (ℝ_≥0)

ZEROS

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.371294359
Minimum	0
Maximum	30
Zeros	226557
Zeros (%)	70.9%
Memory size	2.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	2
95-th percentile	30
Maximum	30
Range	30
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	7.950176157
Coefficient of variation (CV)	2.358196974
Kurtosis	5.530001927
Mean	3.371294359
Median Absolute Deviation (MAD)	0
Skewness	2.604224887
Sum	1077968
Variance	63.20530093
Monotocity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
0	226557	70.9%
30	19502	6.1%
2	14880	4.7%
1	10488	3.3%
3	8616	2.7%
5	7606	2.4%
10	5452	1.7%
15	5012	1.6%
7	4629	1.4%
4	4467	1.4%
Other values (21)	12540	3.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	226557	70.9%
1	10488	3.3%
2	14880	4.7%
3	8616	2.7%
4	4467	1.4%

Value	Count	Frequency (%)
30	19502	6.1%
29	204	0.1%
28	445	0.1%
27	124	< 0.1%
26	66	< 0.1%

MentalHealth
Real number (ℝ_≥0)

ZEROS

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.898182637
Minimum	0
Maximum	30
Zeros	205367
Zeros (%)	64.2%
Memory size	2.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	3
95-th percentile	30
Maximum	30
Range	30
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	7.954713452
Coefficient of variation (CV)	2.040621026
Kurtosis	4.404563305
Mean	3.898182637
Median Absolute Deviation (MAD)	0
Skewness	2.331188413
Sum	1246440
Variance	63.27746611
Monotocity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
0	205367	64.2%
30	17366	5.4%
2	16494	5.2%
5	14149	4.4%
10	10513	3.3%
3	10466	3.3%
15	9896	3.1%
1	9289	2.9%
7	5528	1.7%
20	5430	1.7%
Other values (21)	15251	4.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	205367	64.2%
1	9289	2.9%
2	16494	5.2%
3	10466	3.3%
4	5378	1.7%

Value	Count	Frequency (%)
30	17366	5.4%
29	317	0.1%
28	515	0.2%
27	126	< 0.1%
26	59	< 0.1%

DiffWalking
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	275351
1	44398

Common Values
Chart

Value	Count	Frequency (%)
0	275351	86.1%
1	44398	13.9%

Sex
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

0	167782
1	151967

Common Values
Chart

Value	Count	Frequency (%)
0	167782	52.5%
1	151967	47.5%

AgeCategory
Real number (ℝ_≥0)

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	54.35554451
Minimum	21
Maximum	80
Zeros	0
Zeros (%)	0.0%
Memory size	2.4 MiB

Quantile statistics

Minimum	21
5-th percentile	21
Q1	42
median	57
Q3	67
95-th percentile	80
Maximum	80
Range	59
Interquartile range (IQR)	25

Descriptive statistics

Standard deviation	17.72029002
Coefficient of variation (CV)	0.3260070372
Kurtosis	-1.009483352
Mean	54.35554451
Median Absolute Deviation (MAD)	15
Skewness	-0.3272731296
Sum	17380131
Variance	314.0086785
Monotocity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
67	34148	10.7%
62	33682	10.5%
72	31062	9.7%
57	29752	9.3%
52	25376	7.9%
80	24148	7.6%
47	21790	6.8%
77	21476	6.7%
21	21061	6.6%
42	21005	6.6%
Other values (3)	56249	17.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21	21061	6.6%
27	16953	5.3%
32	18749	5.9%
37	20547	6.4%
42	21005	6.6%

Value	Count	Frequency (%)
80	24148	7.6%
77	21476	6.7%
72	31062	9.7%
67	34148	10.7%
62	33682	10.5%

Race
Real number (ℝ_≥0)

ZEROS

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.396804994
Minimum	0
Maximum	5
Zeros	5201
Zeros (%)	1.6%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	5
median	5
Q3	5
95-th percentile	5
Maximum	5
Range	5
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1.212139683
Coefficient of variation (CV)	0.2756864778
Kurtosis	2.666402192
Mean	4.396804994
Median Absolute Deviation (MAD)	0
Skewness	-1.923831146
Sum	1405874
Variance	1.46928261
Monotocity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
5	245182	76.7%
3	27444	8.6%
2	22932	7.2%
4	10926	3.4%
1	8064	2.5%
0	5201	1.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	5201	1.6%
1	8064	2.5%
2	22932	7.2%
3	27444	8.6%
4	10926	3.4%

Value	Count	Frequency (%)
5	245182	76.7%
4	10926	3.4%
3	27444	8.6%
2	22932	7.2%
1	8064	2.5%

Diabetic
Boolean

MISSING

Distinct	2
Distinct (%)	< 0.1%
Missing	9339
Missing (%)	2.9%
Memory size	2.4 MiB

0	269612
1	40798
(Missing)	9339

Common Values
Chart

Value	Count	Frequency (%)
0	269612	84.3%
1	40798	12.8%
(Missing)	9339	2.9%

PhysicalActivity
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

1	247926
0	71823

Common Values
Chart

Value	Count	Frequency (%)
1	247926	77.5%
0	71823	22.5%

GenHealth
Real number (ℝ_≥0)

ZEROS

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.220932669
Minimum	0
Maximum	4
Zeros	66832
Zeros (%)	20.9%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	4
95-th percentile	4
Maximum	4
Range	4
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.534667273
Coefficient of variation (CV)	0.6910012603
Kurtosis	-1.394283379
Mean	2.220932669
Median Absolute Deviation (MAD)	2
Skewness	-0.1296501094
Sum	710141
Variance	2.35520364
Monotocity	Not monotonic

Histogram with fixed size bins (bins=5)

Value	Count	Frequency (%)
4	113849	35.6%
2	93113	29.1%
0	66832	20.9%
1	34673	10.8%
3	11282	3.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	66832	20.9%
1	34673	10.8%
2	93113	29.1%
3	11282	3.5%
4	113849	35.6%

Value	Count	Frequency (%)
4	113849	35.6%
3	11282	3.5%
2	93113	29.1%
1	34673	10.8%
0	66832	20.9%

SleepTime
Real number (ℝ_≥0)

Distinct	24
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.097026105
Minimum	1
Maximum	24
Zeros	0
Zeros (%)	0.0%
Memory size	2.4 MiB

Quantile statistics

Minimum	1
5-th percentile	5
Q1	6
median	7
Q3	8
95-th percentile	9
Maximum	24
Range	23
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.435732954
Coefficient of variation (CV)	0.2023006444
Kurtosis	7.842039137
Mean	7.097026105
Median Absolute Deviation (MAD)	1
Skewness	0.6774706965
Sum	2269267
Variance	2.061329116
Monotocity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
7	97741	30.6%
8	97594	30.5%
6	66709	20.9%
5	19181	6.0%
9	16036	5.0%
10	7793	2.4%
4	7750	2.4%
12	2204	0.7%
3	1992	0.6%
2	787	0.2%
Other values (14)	1962	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	550	0.2%
2	787	0.2%
3	1992	0.6%
4	7750	2.4%
5	19181	6.0%

Value	Count	Frequency (%)
24	30	< 0.1%
23	3	< 0.1%
22	9	< 0.1%
21	2	< 0.1%
20	63	< 0.1%

Asthma
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	276884
1	42865

Common Values
Chart

Value	Count	Frequency (%)
0	276884	86.6%
1	42865	13.4%

KidneyDisease
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	307975
1	11774

Common Values
Chart

Value	Count	Frequency (%)
0	307975	96.3%
1	11774	3.7%

SkinCancer
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.4 MiB

0	289934
1	29815

Common Values
Chart

Value	Count	Frequency (%)
0	289934	90.7%
1	29815	9.3%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

First rows

	df_index	HeartDisease	BMI	Smoking	Stroke	PhysicalHealth	MentalHealth	DiffWalking	Sex	AgeCategory	Race	Diabetic	PhysicalActivity	GenHealth	SleepTime	Asthma	KidneyDisease	SkinCancer
0	0	0	16.60	1	0	3.0	30.0	0	0	57	5	1.0	1	4	5.0	1	0	1
1	1	0	20.34	0	1	0.0	0.0	0	0	80	5	0.0	1	4	7.0	0	0	0
2	2	0	26.58	1	0	20.0	30.0	0	1	67	5	1.0	1	1	8.0	1	0	0
3	3	0	24.21	0	0	0.0	0.0	0	0	77	5	0.0	0	2	6.0	0	0	1
4	4	0	23.71	0	0	28.0	0.0	1	0	42	5	0.0	1	4	8.0	0	0	0
5	5	1	28.87	1	0	6.0	0.0	1	0	77	2	0.0	0	1	12.0	0	0	0
6	6	0	21.63	0	0	15.0	0.0	0	0	72	5	0.0	1	1	4.0	1	0	1
7	7	0	31.64	1	0	5.0	0.0	1	0	80	5	1.0	0	2	9.0	1	0	0
8	8	0	26.45	0	0	0.0	0.0	0	0	80	5	NaN	0	1	5.0	0	1	0
9	9	0	40.69	0	0	0.0	0.0	1	1	67	5	0.0	1	2	10.0	0	0	0

Last rows

	df_index	HeartDisease	BMI	Smoking	AlcoholDrinking	PhysicalHealth	DiffWalking	Sex	AgeCategory	Race	Diabetic	PhysicalActivity	GenHealth	SleepTime	Asthma
319739	319785	0	31.93	0	1	0.0	0	1	67	3	0.0	1	2	7.0	0
319740	319786	1	33.20	1	0	0.0	0	0	62	3	1.0	1	4	8.0	1
319741	319787	0	36.54	0	0	7.0	0	1	32	3	0.0	0	2	9.0	0
319742	319788	0	23.38	0	0	0.0	0	0	62	3	0.0	1	0	6.0	0
319743	319789	0	22.22	0	0	0.0	0	0	21	3	0.0	1	0	8.0	0
319744	319790	1	27.41	1	0	7.0	1	1	62	3	1.0	0	1	6.0	1
319745	319791	0	29.84	1	0	0.0	0	1	37	3	0.0	1	4	5.0	1
319746	319792	0	24.24	0	0	0.0	0	0	47	3	0.0	1	2	6.0	0
319747	319793	0	32.81	0	0	0.0	0	0	27	3	0.0	0	2	12.0	0
319748	319794	0	46.56	0	0	0.0	0	0	80	3	0.0	1	2	8.0	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows